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Abstract 

Generalized versions of the entropic (Hirschman-Beckner) and support (Elad-Bruckstein) 
uncertainty principle are presented for frames representations. Moreover, a sharpened version 
of the support inequality has been obtained by introducing a generalization of the coherence. 
In the finite dimensional case and under certain conditions, minimizers of this inequalities are 
given as constant functions on their support. In addition, £P-norms inequalities are introduced 
as byproducts of the entropic inequalities. 

Index Terms 

Uncertainty principles, support inequalities, Shannon entropy, Renyi entropy, , lp norms- 
frames, mutual coherence. 

I. Introduction 

The uncertainty principle is originally a quantum physics principle stating that some 
families of observable quantities cannot be measured simultaneously with infinite pre- 
cision. The uncertainty principle can be turned into quantitative statements thanks to 
uncertainty inequalities, which provide bounds on precision of simultaneous measure- 
ments of such quantities. 

The prototype of uncertainty inequality is the celebrated Heisenberg inequality, first 
formulated in [12j, which uses a variance measure as criterion for the measurement 
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precision. Namely, for all x £ L 2 (IR), 

t 2 \x{t)\ 2 dt. v 2 \x(v)\ 2 dv > — -= , 

-oo J — oo 167T 

where the Fourier transform is normalized in such a way that the Fourier transform 
of e~ nil equals e~ nyl . Originally stated for position and momentum, the Heisenberg 
inequality has been extended to more general observable pairs, under the name of 
Robertson inequality |2~T|, ||22||. Particular cases have been analyzed by various authors, 
see e.g. 0, 01, lllOl , I1T5I and references therein. The Robertson variance inequality has 
been criticized in the physics literature, mainly because the bound in the inequality 
sometimes depends explicitely on the left hand side, which has motivated to seek 
alternative formulations. Besides, Robertson- type inequalities do not generalize well 
to all situations: for example, the notion of variance is not necessarily easy to define 
in some contexts, such as for periodic sequences or functions, functions defined on 
compact manifolds or graphs, more generally in situations where the notion of spreading 
away from a reference point is not straightforward. Among the generalizations, entropic 
inequalities, that use entropy measures to quantize measurement precision have enjoyed 
renewed interest recently. In the particular case of the position-momentum situation, the 
corresponding entropic uncertainty inequality, called the Hirschman-Beckner inequal- 
ity [p~3]|. is intimately related to the sharp form of the Hausdorff- Young inequality, the 
so-called Babenko-Beckner inequality lHJ. In signal processing terms, this uncertainty 
principle limits the simultaneous concentration or sparsity of a function and its Fourier 
transform. The inequality provides a lower bound on the differential entropies of their 
respective square moduli. 

Uncertainty inequalities have received a renewed interest in the context of sparse 
approximation and signal processing applications. Often in a finite-dimensional setting, 
1? norms (with p < 2) are used to measure dispersion of signals. This provides some 
quantities in order to compare the sharpness of different representations (I 2 vectors) of a 
signal x or probe the concentration of information inside them. For example, the signal 
itself and its Fourier transform are two representations of the same mathematical object. 
More generally, any projection of x on a basis of the Hilbert space gives a representation 
of the signal. In this context, uncertainty bounds involving 1 quasi-norm and i 1 norm 
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have been derived. A prototype of such bounds is the Elad-Bruckstein £° inequality: 
given two orthonormal bases in a finite-dimensional Hilbert space and any vector x in 
that space with set of coefficients a and b with respect to the two bases, 

M o & o > > 
K 

where }i is a constant called mutual coherence, that depends on the two bases (and not 

on x). Such results have important implications for practical problems, as shown in the 

pioneering work of Donoho and Stark [8J. For instance, £° bounds have been used to 

prove the equivalence of £° and ^-based sparse recovery algorithms, under suitable 

sparsity assumptions 0, 0. Results of similar nature have also been obtained in the 

context of the Fourier transform on abelian groups (see for example ||24|, [HI, [18]). As 

is well known in information theory, and remarked also in [|20|, Shannon entropy and 

£P norms are closely connected, through Renyi entropies. Inequalities involving Renyi 

entropies 11X611 , |6J actually imply both Shannon entropy inequalities and £? inequalities. 

This study has been divided into two parts (Sec. [Q] and Sec. [in) . In the first part, we 

analyze such support (£°) inequalities in the context of frame decompositions, as follows. 

Given two frames IA and V in a Hilbert space H, denote by U and V the corresponding 

analysis operator. Ux and Vx are the two representations of x with respect to the frames. 

For any we prove for example a bound of the form 

. „ .. 1 
\\Ux o \\Vx o > o , 

n 

where ji^ is a constant that only depends on the two frames. In the case of orthonormal 
bases, these inequalities yield refined forms for support inequalities (fi^ < fi), for which 
we can analyze conditions for equality. The refined inequalities involve cumulated 
coherence measures, instead of the standard coherence measures used classically. In 
the case of frame decompositions, the inequalities we obtain concern analysis coeffi- 
cients, while most recent contributions (in the domain of sparse decompositions and 
approximation) focus on inequalities involving synthesis coefficients. Therefore, exact 
recovery results such as those derived in [pTT]| do not apply directly to the new 
results. Though, given the renewed interest on analysis-based sparse decompositions 
and co-sparsity (see e.g. |19J), we believe that these new inequalities are of interest, 
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as they can yield bounds for the performances of cosparse signal recovery methods. 
Consider for instance the following signal separation problem: given two frames U and 
V, and some observed signal u G %, we want to split u as a sum of two components 
whose respective analysis coefficients with respect to frames U and V are sparse. In 
other words, we want to solve 

min [||Ux||o + ||Vy||o] under constraint u = x + y . 

x,yeH 

where U and V are the analysis operators of two frames under consideration. Given 
two such decompositions u = x + y = x' + y' , the above support inequality directly 
leads to 

||lTx|| + ||yy||o+||Wx / || + llVy'Ho 

> ||u(x-*')llo + ||V r (y'-y)||o> — . 

Therefore, if one is given a splitting of the form u = x + y such that ||LTx||o + ll^/llo < 
1/^^, this splitting is automatically the solution of the above optimization problem. 

Besides support size estimates, we also obtain entropic inequalities for analysis co- 
efficients with respect to frames, that explicitely involve the frame bounds. This is 
developed in the second part of the study. As a particular case, Shannon entropy bounds 
are derived, and it is shown that the latter are only informative for tight frames. In the 
latter case, the entropy inequalities take a fairly simple form; for example, denoting by 
S(a) the Shannon entropy of a vector a, we show that given two tight frames U and V, 
with respective analysis operators U and V, then 

S(Ux) + S(Vx) > -21n(//J . 

Such inequality also turns out to yield the above mentioned support inequalities as a by- 
product. Finally, we also derive new inequalities as consequences of Renyi entropic 
inequalities. 

II. Refined Elad-Bruckstein £° inequalities 

A. Notations 

We first introduce the general setting we shall be working with. Throughout this 
paper, we shall denote by U = {u^,k € A} and V = {v?, £ (E A} two countable 
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frames for the Hilbert space H (we refer to for a self contained account of frame 
theory). Here, the index set A will be finite when Ti is finite-dimensional, and infinite 
otherwise. ||x|| also written ||x||2 is the norm of x in Ti. We denote by Ay, By and Ay, By 
the corresponding frame bounds, i.e. we have for all x G H 

(1) 
(2) 

Let U : % — > i 2 (A) and V : % — > i 2 (A) be the corresponding analysis operators, i.e. 

a k = (Ux) k = (x,u k ) , b e = (Vx) e = {x,v e ) , xeH, (3) 

and denote by T = VU^ : a — ^ b the change of frame operator (with IT + the Moore- 
Penrose pseudo-inverse of U). We shall also denote by U and V corresponding (generic) 
dual frames, among which the canonical dual frames will be denoted by IA° = (IPti)"^ 
and V° = (V*y) _1 V. As is well known (see B2l), the corresponding frame bounds are 
respectively Aq = 1 /By, Bq = l/Ay, and similarly for V. We recall that in the 
particular case where U and/or V are (Riesz) bases, U and/or V are the corresponding 
bi-orthogonal bases. 

In the following, we shall make use of the following quantity: 

Definition 1: Let r G [1,2], let r' be conjugate to r, i.e. such that l/r + 1/r' = 1. The 
mutual coherence of order r of two frames U and V is defined by 

fi r (U,V) = sup (^\{u k ,v e )\^ , (4) 

In the case r = 1, this corresponds to the standard mutual coherence, simply denoted 
by }i(U,V). 

This quantity is clearly well-defined in finite-dimensional settings. Notice also that in 
infinite-dimensional situations (i.e. when A is an infinite index set), this quantity is 
well-defined for all r G [1,2]. Indeed, fi 2 (U,V) < By sup £ \\vg\\ 2 , and ^ /r (U,V) < 
ji 2 (U,V) sup ke \(u k ,V()\ r '~ 2 , which is finite since r' > 2. 

In finite-dimensional situations, the notion of mutually unbiased bases has been 
introduced in the physics literature by Sch winger |23| (see ||25| for a review). 

October 30, 2012 DRAFT 



6 



Definition 2: Two orthonormal bases U and V in an N-dimensional Hilbert space T-L 
are mutually unbiased (MUB) if 

\(u k ,v £ )\ = -L , VM = 0,...N-1 . 



U and V are blockwise mutually unbiased bases (BMUB) of U if U = {U^,...U^}, 
V = {VW ...V^}, where for all k = 1,. . .K, and span the same subspace 

of dimension N k , and are MUBs for U {k \ with © fc H (fc) = H. 
Notice that the coherence of a MUB in an N-dimensional Hilbert space equals }i{U, V) = 
1/VN, the corresponding r-coherence equals ji r {U,V) = N r/2 ~ 1 , and the r-coherence 
of a BMUB equals fi r {U,V) = max fc N fc r/2_1 . 

B. Refined Elad-Bruckstein inequality 

The classical Elad-Bruckstein £° inequality H (a strong form of which has been given 
in (HI) gives a lower bound for the product of support sizes of two orthonormal basis 
representations of a single vector. The inequality can be extended to the frame case and 
generalized as follows. 

Theorem 1: Let U and V be two frames of the Hilbert space H. For any x G 7i, x ^ 0, 
denote by a = Ux and b = Vx the analysis coefficients of x with respect to these two 
frames. 

1) For all r G [1,2], coefficients a and b satisfy the uncertainty inequality 

„ ii M M 1 

N o- b o > ~ ~ • (5) 

~ ~ 2 

Therefore, |N|o.||b||o > 1 (W, V, V) , where 



^{U,U,V,V) = inf Jji r (U,V)ji r (V,U) . (6) 

2) For all r £ [1/2], the inequality can only be sharp if the following three properties 
hold true: 

i. the sequences \a\ and \b\ are constant on their support, 

ii. for all k G supp(fl) (resp. i G supp(fc)) the sequence £ — > \{ufo v e)\ (resp. 
/c — > \{v£,u k }\) is constant on supp(fc) (resp. supp(a)). 

iii. for all k G supp(a),£ G supp(b), arg({u k ,v e )) = arg(fy) - arg(a fe ) = - arg((%«jt)). 
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Proof: 

1) Let r e [1,2], let x e U, x ^ 0. First remark that 

H&lloo = SUp | (x,Vt) | 

= sup (Y^a k u k ,v £ 

£ \ k 

< sup J^\a k \ \ (u k ,v e ) \ , 
I k 

and Holder's inequality yields 

||fc||oo< \\a\\ r fi r (U,V) 1/r (7) 

Similarly, 

||fl||oo< \\b\\ r fi r (V r U) 1/r ■ (8) 

Then, notice that 

\\a\\r < ||«||o < ||fl||o ll^llr Vr(V> U ) ■ 

The same estimate on ||b|| r proves the first part of the theorem. 

2) Assume first r ^ 1. As for the sharpness of the bound, notice first that the 
inequality \\a\\ r r < ||«||o || fl ||oo is sharp if and only if \a\ is constant on its support 
(similarly, \b\ has to be constant on its support). Now in the first inequality, 
Holder's inequality is an equality if and only if the sequence k — > \(u k ,vi)\ r ' 
is proportional to \a\ r , meaning that the sequence k — > \{u k ,V()\ is constant on 
its support, which coincides with the support of a. A similar reasoning is done 
for b and the sequence £ — > \(v£, u k )\. The last inequality to be investigated is 

^ Xjc \ a k\ \ {ukr v t)\- The latter becomes an equality if and only if the sum 
only involves positive numbers, i.e. iff arg((u k ,Vi)) = arg(^) — arg(%)- A similar 
reasoning yields the condition arg((z)£, u k )) = arg(a fc ) — arg(b(). 
Finally, consider the case r = 1. The above argument can be reproduced exactly, 
except for the tightness argument for Holder's inequality. The latter can now be an 
equality only if the sequence k — > \ (u k , v^) \ is equal to a constant (namely, }i(U, V)) 
on supp(fl), and smaller outside the support. This does not change the conclusion. 
This concludes the proof. 4 
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Remark 1: 1) Clearly, by the arithmetic-geometric inequality, we also obtain the 
bound 

2 

a o+ \\b\\o> - (9) 

2) Using exactly the same techniques, the uncertainty inequality can be extended to 
K frames. Given K frames U^ k \ k = 1, . . . K and denoting by aS® the corresponding 
sequences of analysis coefficients of any x € %, we readily obtain the bound 

iifl(i)iio.ii«( 2 )|| ...ii««iio> (n^ } ) 1 ( io ) 

where 



and again by the arithmetic-geometric inequality, 

ii« (i) iio+ii« (2) iio+---+n« w iio>^ (n^ fc) ) • (ii) 



Remark 2: We notice that when W and V are orthonormal bases the result generalizes 
the Elad-Bruckstein inequality When U and V are non-orthonormal bases IA and V are 
their respective biorthogonal bases and we obtain a straightforward generalization. In 
the case of frames, let us point out that the generalization we obtain concerns analysis 
coefficients rather than synthesis coefficients. 

Remark 3: Notice finally that these bounds involve arbitrary dual frames IA and V of 
IA and V, not necessarily the canonical ones. Therefore the bound can be make more 
general, in the form 

MWWbW^i/v^iuy) 1 , (12) 

where 



?„(W,V) = inf inf Jji r (U f V)ji r (V f U) , (13) 

U,V re [1,2] v 

the infimum running over the family of dual frames of IA and V. A characterization of 
such families can be found in [2], Theorem 5.6.5. 
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C. Examples and comments: the case of orthonormal bases 

Consider first the case where IA and V are two orthonormal bases in finite dimensional 
Hilbert spaces. First notice that the case r — 1 provides an elementary proof of the Elad- 
Bruckstein inequality (which involves 1/jiAjA, V) 2 as a lower bound), together with 
explicit conditions for sharpness. In the particular case of mutually unbiased bases, i.e. 
orthonormal bases such that \{u^,Vi)\ is constant, fi r (U,V) = N r ^ 2 ~ 1 is monotone and 
minimal for r = 1, which yields the usual coherence ]i = fi-, — 1/ \/N, N being the 
dimension of the considered Hilbert space. An example of mutually unbiased bases is 
provided by the Kronecker and Fourier bases in R N , in which case the Elad-Bruckstein 
inequality coincides with the inequality derived before by Donoho and Huo fl7J. For 
blockwise mutually unbiased bases, we also obtain a monotone function of r for the 
r-coherence ji r (U,V) = maxj. N r k /2 ~\ which means that again the optimal bound is 
provided by ji v 

In the case of orthonormal bases, the smallest possible value for the coherence is 
provided by the Welch bound: fi > l/y/N. Therefore, we obtain 

Corollary 1: Assume IA and V are orthonormal bases. The optimal bound for the re- 
fined Elad-Bruckstein uncertainty inequality is attained in the case of mutually unbiased 
bases, for r = 1. 

Consider now the case where the inequality is an equality, in the case r 7^ 1. By 
Theorem [T| the analysis coefficients a and b of the corresponding optimizer are such 
that \a\ and \b\ are constant on their support. The proof of part 2. of the theorem also 
implies that for k £ supp(a), the sequence i — > \{u] l ,Vi)\ vanishes outside supp(fr) 
and equals a constant on supp(fc); The latter constant equals necessarily ||£>||(7 1/2 / and 
fi r (U,V) = ||&||o /2-1 - Similarly, fi r (V,U) = \\a\\ r • Assume finally that the inequality 
be an equality, the latter thus reads 

ll fl l|o-|| llo — ll fl llo -H^llo ' 

which implies (for nonzero signals x) ||fl||o.||b||o = 1/ i-e. the two bases have at least one 
common element, and the signal is a multiple of one of these common elements. 

Corollary 2: Assume IA and V are orthonormal bases. For r / 1, the corresponding 
refined Elad-Bruckstein inequality cannot be an equality, unless the two bases have a 
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common element. 

Notice however that the case r £ [1,2] constitutes a true generalization; indeed, 
for general pairs of orthonormal bases, it turns out that sup r [l / ft r (U , V)fi r (V, U)} > 
1/ji^lA, V) 2 . This is examplified in Figure fll where are displayed the functions }i r (U,V), 



}i r (V,U) and ^/}i r {U, V)}i r (V ,U) as a function of r, in a generic situation: the two bases U 
and V are random bases, obtained by diagonalization of random (Gaussian) symmetric 
matrices. As can be seen in this picture, the minimum of these three functions is not 
attained for r = 1 but for a larger value. For the sake of comparison, the case of mutually 
unbiased bases is also represented and exhibit a power law behavior as a function of 
r (represented as a straight line in the logarithmic plot). This shows that the coherence 
based bounds are not the best possible ones in general. Elementary infinitesimal calculus 
yields the following expression for the behavior of the r-coherence near r = 2: 

ji r {U, V) =1 - (2-r) max \ (u k , v t ) | 2 In (| (u k , v £ ) \ 2 fj 

+ 0((2-r) 2 ), 

i.e. the slope of the tangent at r = 2 is given by the entropy-like expression 

slope = -^2\(u k/ v e )\ 2 ln (\(u k ,v?)\ 2 ) 
k v 7 

(see section below), which is known to be minimal (in finite dimensional situations, 
see for more details) when the \ {u k ,vi)\ 2 are all equal. 

More generally, we have the following result on r-coherences. 

Proposition 1: Let {u k } k and {u/}; be two frames in the Hilbert space % of dimension 
N.Fix I, let S/ = maxjt \ {u k ,V\) \ and denote by nj = $(\(u k ,Vi)\ = S/) the multiplicity of 
this maximal value. If max; n\S\ < 1, then there exists r > 1 such that }i r < 
Proof: It is enough to show that the derivative of }i r is negative at r = 1 under the 
stated conditions. Let us introduce the notation 

^ r/r' 

Ski = \ (uk,vi)\ and Lj(r) = In ( 

so that ]i r = supj L/(r). If for all I the derivative of L\ is negative, so is the derivative of 
ji r . Since {u k } k and {v{\i are frames, XjtSjtz > for all / and L/ is well-defined as well 
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Fig. 1. Logarithm of r-coherence functions as a function of r. fi r (U,V) (dashed), fi r (V,U) (dash-dotted) and 
^J}i r {U, V)fi r (V,U) (full); straight line: mutually unbiased bases. Top: random bases U and V. Bottom: MDCT bases 
with different window sizes. 



as its derivative near r = 1, r > 1. This latter reads: 

L',(r) = lntt/s; + ^m 1 + ~~~T E 4? 

/ceA keA 



1 




+ o 

where oc^j = \(u^,Vi)\/niSi and A is the set of k such that \(u] i ,vi)\ ^ sj. For r close to 
one, the dominant term is lnn/S/. In this case, if max; n/S/ < 1, the derivative of ]i r is 
negative. 4* 
Remark 4: If two orthonormal bases have a high mutual coherence this implies 
that a single term is dominant and since in this case S; < 1, Proposition [ljholds. However 
for frames with high coherence S/ is large for some I, and it is highly probable that its 
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multiplicity be large as well. In this case, the conditions of the proposition are not 
satisfied and ]i r may not be smaller than If there is too little coherence (like in 
MUB), n\ may be large and again }i r may not be smaller than Finally, for MUB, 
n\S\ = VN, this is the slope of the curve plotted on Fig. [l] 

III. Entropic inequalities 

The support inequalities described above can also be obtained as particular limits of 
entropic inequalities, which have been derived during the last 20 years in the mathe- 
matical physics and information theory communities. 

A. Entropies 

In information theory, the notion of entropy is often used to measure disorder, or 
information content of a random source; entropy measures are basically related to 
measures of dispersion of the probability density function of the random variables under 
consideration. 

In the context of sparse analysis, the coefficients of the decomposition of any finite- 
norm vector with respect to a frame can be turned into a probability distribution, after 
suitable normalization. With the same notations as before, denote by a the sequence 
of analysis coefficients of x G % (x 7^ 0) with respect to the frame U, and we set 
a = a/ 1| a || 2. Given a G [0, 00] we introduce the corresponding Renyi entropy 

RM = in(||a||j£) • (14) 

Renyi entropies fulfill a number of simple properties, among which we will use the 
following two: monotonicity and limit to Shannon's entropy. More precisely, for a given 
coefficient sequence a, 

a< p =^ R tt ( a ) > Rp(a) , (15) 

and 

lim Ra(a) = — Y~" |5 n | 2 ln ( \a n \ 2 ) = S(a) . (16) 

S(a) is the Shannon entropy of the coefficient sequence. Also, notice that Ro{a) = In ||fl||o- 
This will lead to support inequalities as consequences of Renyi entropy inequalities. 
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Uncertainty inequalities involving entropy measures have been derived in several 
different contexts (see [H, 10, |[T7| for example). We derive below similar inequalities 
in a more general setting. 

B. Entropic uncertainty inequalities for frame expansions 

As above, let us consider two frames IA and V. We use the same notations as in the 
previous section, and introduce the following additional constants: the geometric mean 
of the upper frame bounds p, the geometric mean of frame bounds ratios c, and the 
normalized r-coherence v r , written as 




4 lBv ^ v > 4 i/^>i. 

P (u,vy ■ <17) 

For the sake of simplicity, we shall drop the r index in the case r — 1, and set fi = fi 1 and 
v = v\. We then have the following theorem, which can be seen as a frame generalization 
of the Maassen-Uffink uncertainty inequality ffT7|, ||6|: 

Theorem 2: Let % be a separable Hilbert space, let U and V be two frames of H, and 
let U and V denote corresponding dual frames. Let r G [1,2). For all a G [r/2,1], let 
B = &(r - 2) I (r - 2a) G [l,oo]. 

For x £ H, denote by a and & the sequences of analysis coefficient of x with respect 
to U and V. Then the Renyi entropies satisfy the following bound: 

{2-r)R a {a)+rRp{b) > -21n(v r {U,U,V)) 

Proof: the proof is both a refinement and a frame generalization of the proof in |T7|, 
|6|. Let T : a — > b denote the linear operator of change of coordinate. From the frame 
bounds, we obviously have the inequalities 



II&II2 < \ I — — I2 / \ a '\2 S 

so that we have the estimate 





\T\\ 1 ^2<\\^ u =p{U,V) . (18) 
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A second bound is obtained as in ([7]), and yields 

imir-. =^{U,V) Vr . (19) 

Let po = qo = 2, p\ = r, q\ = oo, and set for 6 £ [0, 1] 

11-0 9 1 _ 1 -6 
p ~ 2 + r' q~ 2 ' 

Clearly, 1 — 6 = 2/q and 6 = 1 — 2/q = r(l/p — 1/q), and the Riesz-Thorin lemma 

yields the following bound. 

||T||^ < ii r {ti,V) {1 - Vq),r p{U,V) 2/ « , (20) 

Using the definition of a and b and the frame bounds, we deduce 



< (riU^VriUM^f^^^WaWp , (21) 
where we have used the bound ||fl||2/||&||2 < ptyM) and the definition of v r and c 



in (171. 



Set now p = 2a and q = 2/3; taking logarithms, we get 



2a 



\n{o-{U,V)) , 



Since (j6 — 1)/j6 = 1 — 2/q = r(l/2« - 1/2/3), this implies 

^fy^(«)+^(&) > -*lnv r (Z/,W,V) 

-2^]n(<r(W,V)) . 
Finally, explicit calculations give a = p>/ (r + 2(/3 — 1)), so that 

T^TT = — e ^ ' 

a(p — 1) r 

which yields the desired result. 4 

Notice that since (2 — r)/r € [0,1], this implies the (generally non sharp) inequality 

2-26 
R a ( fl ) > --ln(v r (W,W,V)) - j^bx{<r{U,V)) 

DRAFT October 30, 2012 



15 



It is also worth noticing that in general, the limit a -} 1 (which yields the sum of 
the Shannon entropies as left hand side) is non-informative, since the right hand side 
tends to — oo, unless cr = 1, i.e. IA and V are tight. In that case the following simplified 
inequalities hold true: 

Corollary 3: Assume U and V are tight frames, and let r G [1,2): 

1) For all a G [r/2,1], with $ = cc(r - 2) /(2a - r) G [l,oo] 

(2-r)R a (a)+rRp(b) > -21n(v f (W,W, V)) . (22) 

2) the following inequalities between Shannon entropies hold true: 

S(a) + S(b) > -21nta(W,W,V,V)) , (23) 

where is defined in 
Proof: the first item is a direct consequence of the previous theorem in the case of tight 
frames. For the second item, remark that from the monotonicity of the Renyi entropy, we 
obtain (2 — r)S(a) + rS(b) > (2 — r)R a (a) + rRa(b). Remark also that for tight frames, 



v r {U,U,V)v r {V,V,U) 



cr(u,vy 

Fr (U,V) Fr (V,U) 



Symmetrizing the bound on Shannon entropies yield the desired result. 4k 

Notice that owing to the monotonicity property of Renyi entropies, Ro(fl) = ln(||a||o) > 
S(a), and we recover the generalized Elad Bruckstein inequality 

I, M 1 1 II 1 

fl h- \\o o > ~ ~ — • 

110 - ^{U,U,V,V) 2 

Similar results in the general case are discussed below. 

C. Consequence: £ p inequalities for analysis frame coefficients 

Let us start again from the modified entropic inequality in Theorem [2j and symmetrize 
it with respect to a and b. We obtain 

(2 - r) (R a (a) + R a (b)) + r{R p {a) + Rp(b)) > 

- 2h ( & y )-^ h (^v))- 
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Using the monotonicity of Renyi entropies, i.e. R a > Rp, we then get for all a. G [r/2,1] 

R«(a) + R a (b) > -ln(/< r (W,V)/i r (V,W)) 

6 + 1 



ln(<r(W,V)) , 



thus 



ln(||fl|| 2a .||5|| 2a ) > - l -^\rv(ji r {Uy)p r {VM)) 

(j8 + l)(l-a) .... 
" r 2*(jB-l) ln ^ V )) 

-H)(^H*v,) 



finally yields the bound, for p G [r, 2] 



2 p 



H v \\b\\ v >(ji r {U,V)ii r {V,U) 



\a\\ 2 .\\b\\2 ■ (24) 



Also, using the fact that Ro(a) = ln(||a||o) > Rct{a) for all a € [r/2,1], and specifying to 
the sharpest bound a — r II, we also obtain 

ln(||fl|| .||&||o) > -ln(^(W,VK(V,W)) -rln((r(W,V)) , 

which yields 

|H| .||»||o > cr(U,V)-r 1 . (25) 

}i r {U,V)}i r {V,U) 

It is worth noticing that this bound is similar to the support inequalities obtained 
previously, except for the factor cr(U,V)~ r , which makes it weaker. Thus the bound 
is equivalent to the previous one if and only if the frames are tight. Notice also that 
sharper bounds are obtained, as before, by optimizing with respect to r and the dual 
frames U and V of U and V. 
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D. Remark: necessary conditions for equality in the tight case 

We now examine conditions for the entropic inequalities be saturated. Our aim is to 
make the connection with the constant on support property we already met in Theorem [T] 
and its proof. Since the entropic bounds we could prove are not sharp in generic 
situations, we limit the present discussion to the particular case of tight frames. Let 
hi and V be two tight frames, denote by An = By and Ay = By the corresponding 
frame constants, and set 

gk£ = (ue,v k ) . (26) 

Straightforward calculations give 



d Wll I 

7— ln( \\a\ 
dag 



2a ^ 
2a) 



\a e 


2a 


\\a\ 


\2a 
12a 



and 



12/3 



2-r a 1 


a( 


2a 


r I — aa~i\ 


\a\ 


|2a 
\2a 



fc=0 A H&l 

and therefore the variational equations associated with the optimization of {2.1 r — 
l)R a (a) + Rp(b) under constraint \\x\\ = 1 = ||fl||/vA read 

where A is a Lagrange multiplier. Now remark that B/ (1 — 6) = — a(2 — r)/r(l — ex); 
multiplying both sides with % and summing over k, the constraint ||x|| = / \[A~u = 1 
gives A = 0, so that the variational equations take the form, for a / 1 

I N-l i£ 12(0-1) 

a * = XT E Ski -j^iT bk ■ (27) 

Remark 5: From the above expression, we can observe that \a\ is constant on its sup- 
port if and only if \b\ is, since YLkSkftk = «/• In this situation, we have |%| = V A~u7 \\ a \\o 
for all k G supp(fl) and \bi\ = ^/ Ay / \\b\\o for all k G supp(b), so that 

R a (a) +Rp{b) = ln(||fl|| .||fo||o) , 
which therefore saturates the inequalities. 

Similar calculations on the Shannon entropy yield a comparable result. 
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12a 



18 



IV. Conclusions 

We have examined in this paper entropic and £P uncertainty principles in the frame- 
work of frame expansions. Our main results are extensions of support and entropic 
uncertainty principles to the case of frames, which turn out to generalize some known 
results when specializing to orthonormal bases. We showed in particular that in general 
situations, bounds involving the classical mutual coherence of the frames or bases under 
considerations are outperformed by the new bounds involving generalized coherences. 

While £ p uncertainty principles have been mainly exploited in the framework of 
sparse expansion problems, i.e. synthesis based approaches, our results fit better into the 
so-called analysis frameworks (see e.g. |fl9f), as shortly explained in the introduction. Prac- 
tical consequences for co-sparse signal approximation and decomposition approaches 
are still to be investigated further. This is ongoing work by the authors of the present 
paper. 

Let us mention that the finite dimensional case is by now fairly well understood, 
and the existence of optimizers for the uncertainty inequalities is closely connected to 
coefficient sequences that are constant on their support, as already remarked by [20J. 
In the infinite-dimensional case, such constant on support properties do not make much 
sense in general situations, and the optimization problem is still to be investigated much 
further. 
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